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Abstract 


Shipboard  Command  and  Control  (C2)  presents  unique  challenges  for  decision 
support.  Tactical  decisions  require  that  the  ship’s  Command  Team  gain  timely  access 
to  and  comprehend  the  significance  of  large  amounts  of  information  that  may  impact 
on  the  mission.  While  operations  depend  heavily  on  doctrine  and  standard 
procedures,  many  tactical  details  must  be  established  in  real  time,  particularly  as 
unanticipated  events  or  anomalous  situations  arise.  This  imposes  significant  cognitive 
demands  on  operators  for  active  situation  assessment  and  decision  making,  where 
benefits  for  performance  improvements  may  be  expected  from  incorporating  advanced 
support  tools  like  decision  support  systems  and  integrative  work  aids  and  displays. 
Cognitive  Work  Analysis  (CWA)  is  a  layered,  systems-based  analysis  framework  that 
specifically  addresses  system  design  to  support  operators  in  unanticipated  situations. 
Its  first  layer  is  a  work  domain  analysis  (WDA),  which  develops  hierarchical  models 
representing  the  intentional,  functional,  and  physical  properties  of  the  work  domain,  at 
different  levels  of  abstraction,  as  well  as  the  relations  between  these  levels.  In  this 
document,  we  discuss  the  results  of  a  year-long  study  of  the  application  of  WDA  to 
tactical  C2  for  the  Canadian  Navy’s  HALIFAX  Class  frigate.  We  review  the  WDA 
models  that  resulted  and  briefly  describe  some  applications  of  the  CWA  approach  in 
this  work  environment.  This  work  is  part  of  ongoing  research  to  evaluate  the  role  of 
CWA  in  C2  system  design. 

Resume 


Le  commandement  et  le  controle  (C2)  a  bord  des  navires  posent  des  difficultes 
particulieres  au  chapitre  de  l’aide  a  la  decision.  Les  decisions  tactiques  exigent  de 
l’equipe  de  commandement  du  navire  d’ absorber,  en  temps  opportun,  de  grandes 
quantites  de  renseignements  qui  peuvent  affecter  leur  mission  et  de  les  comprendre. 
Alors  que  les  operations  reposent  surtout  sur  la  doctrine  et  les  procedures  normales,  de 
nombreux  details  tactiques  doivent  etre  regies  en  temps  reel,  particulierement  lors 
d’evenements  imprevus  ou  de  situations  anormales.  Evaluer  une  situation  en  cours  et 
prendre  des  decisions  exigent  des  efforts  cognitifs  importants  de  la  part  des 
operateurs.  II  est  previsible  que  l’ajout  d’outils  perfectionnes  comme  des  aides  a  la 
decision,  ainsi  que  des  aides  et  des  affichages  d’integration  du  travail  pourra  ameliorer 
l’execution  de  leurs  taches.  L’Analyse  de  travail  cognitif  est  un  cadre  d’analyse  en 
couche,  axe  sur  les  systemes  et  defini  pour  concevoir  des  systemes  en  appui  aux 
operateurs  confrontes  a  des  situations  imprevues.  La  premiere  couche  est  l’Analyse 
du  domaine  de  travail.  Elle  permet  de  creer  des  modeles  hierarchiques  des  proprietes 
intentionnelles,  fonctionnelles  et  physiques  du  domaine  de  travail,  a  differents  plans 
d’ abstraction,  et  de  representer  les  relations  entre  ces  plans.  Dans  ce  document,  nous 
presentons  les  resultats  d’une  etude  d’un  an  sur  l’application  de  l’Analyse  du  domaine 
de  travail  au  commandement  et  au  controle  tactiques  a  bord  des  fregates  de  la  classe 
Halifax  de  la  Marine  canadienne.  Nous  examinons  les  modeles  produits  par  l’Analyse 
du  domaine  de  travail  et  decrivons  brievement  certaines  utilisations  de  1’ Analyse  du 
travail  cognitif  dans  cet  environnement.  Ce  rapport  fait  partie  d’une  recherche  en 
cours  pour  evaluer  le  role  de  l’Analyse  du  travail  cognitif  dans  la  conception  d’un 
systeme  de  commandement  et  de  controle. 
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Executive  summary 

Background 

The  beginning  of  the  21st  century  is  witnessing  a  number  of  significant  and  growing 
challenges  in  naval  warfare.  Developments  in  the  capabilities  and  numbers  of 
maritime  threats,  as  well  as  the  accompanying  shift  in  emphasis  from  blue  water  to 
littoral  operations,  are  among  the  many  factors  widely  anticipated  to  lead  to  increasing 
demands  on  shipboard  information  processing,  information  management,  and 
command  decision  making.  Now,  more  than  ever,  advanced  decision  support  systems 
and  collaborative  or  integrative  work  aids  and  displays  are  needed  to  help  operators 
manage  the  increasing  amounts  of  information  in  a  way  that  creates  flexible  problem 
solvers  from  naval  command  teams  and  harnesses  their  individual  and  combined 
expertise  and  adaptive  capabilities  to  the  full. 

Principal  results 

This  document  presents  results  from  an  ongoing  investigation  of  the  Cognitive  Work 
Analysis  framework.  We  are  developing  and  using  Cognitive  Work  Analysis  models 
of  the  cognitive  demands  of  tactical  Command  and  Control  work  on  the  HALIFAX 
Class  frigate  as  a  basis  for  designing  computer-based  tools  to  support  these  demands. 
We  examine  one  study  in  which  a  Work  Domain  Analysis,  the  first  of  the  analysis 
layers  in  a  Cognitive  Work  Analysis,  was  conducted  to  develop  a  hierarchy  that 
structurally  represents  the  broadest  limits  of  the  domain’s  constraints  that  create 
tactical  action  opportunities  on  the  frigate.  The  study  also  looked  at  some  specific 
applications  of  the  models  that  resulted  from  the  Work  Domain  Analysis. 

Significance  of  results 

The  literature  attests  to  the  difficulty  of  designing  effective  support  in  cognitively 
demanding  work  environments  like  that  of  tactical  Command  and  Control.  There  is 
strong  evidence  for  the  merit  of  following  a  work-centred  approach  that  models  the 
cognitive  demands  of  the  work  as  the  basis  for  tool  design.  A  work  analysis  is  a  key 
part  of  such  an  approach.  The  results  of  this  work  are  developing  our  understanding 
of  the  benefits  of  using  the  Cognitive  Work  Analysis  framework  for  this  analysis. 

Future  work 

Work  is  ongoing  to  explore  using  Cognitive  Work  Analysis  in  the  HALIFAX  Class 
Operations  Room  to  model  information  exchange  in  collaborative  work,  and 
information  flow  and  integration  among  the  different  teams  in  building  and 
maintaining  a  tactical  picture. 


Chalmers,  B.A.,  Burns,  C.M.,  and  Bryant,  D.J.  2001.  A  work  domain  analysis  of  shipboard 
Command  and  Control.  TM  2001-212.  Defence  Research  Establishment  Atlantic. 
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Sommaire 


Contexte 

En  ce  debut  du  XXIe  siecle,  nous  faisons  face  a  plusieurs  defis  importants,  et  d’une 
ampleur  croissante,  au  chapitre  de  la  guerre  maritime.  L’accroissement  des  menaces 
maritimes,  tant  en  capacite  militaire  qu’en  nombre,  ainsi  que  le  deplacement 
consecutif  de  l’emphase  des  operations,  de  la  haute  mer  vers  les  cotes,  font  partie  des 
nombreux  facteurs  qui  devraient  conduire,  sur  les  navires,  a  une  demande  accrue  pour 
le  traitement  des  informations,  la  gestion  des  informations  et  la  prise  de  decisions  de 
commandement.  Nous  avons  besoin,  plus  que  jamais,  de  systemes  perfectionnes 
d’aide  a  la  decision,  ainsi  que  des  aides  et  des  afficheurs  pour  le  travail  en 
collaboration  ou  le  travail  integre.  Tous  ces  systemes  aident  les  operateurs  a  gerer  des 
quantites  croissantes  de  renseignements  et  permettent  de  former,  au  sein  des  equipes 
de  commandement  maritime,  des  solutionneurs  de  problemes.  Ces  systemes 
permettront  d'utiliser  au  mieux  leur  expertise  personnelle  ou  commune  et  leur 
souplesse. 

Resultats  principaux 

Dans  ce  document,  nous  presentons  les  resultats  de  notre  recherche  en  cours  sur 
l’Analyse  du  travail  cognitif.  Nous  mettons  au  point  et  utilisons  des  modeles,  issus  de 
l’Analyse  du  travail  cognitif,  des  exigences  cognitives  requises  par  les  taches  de 
commandement  et  de  controle  tactiques  sur  les  fregates  de  la  classe  Halifax.  Nous 
utiliserons  les  resultats  de  1’ analyse  pour  concevoir  des  outils  informatiques  pour  aider 
a  remplir  ces  taches.  Nous  examinons  une  etude  dans  laquelle  l’Analyse  du  domaine 
de  travail,  la  premiere  couche  d’ analyse  de  1’ Analyse  du  travail  cognitif,  a  ete 
effectuee  pour  creer  une  hierarchie  qui  represente  structurellement  les  limites  les  plus 
larges  des  contraintes  definissant  le  domaine  et  qui  cree  les  possibilites  d’ actions 
tactiques  sur  une  fregate.  L’ etude  a  aussi  examine  certaines  applications  specifiques 
des  modeles  resultant  de  l’Analyse  du  domaine  de  travail. 

Importance  des  resultats 

La  documentation  scientifique  atteste  de  la  difficult^  a  concevoir  un  soutien  efficace 
pour  des  environnements  de  travail  exigeants  du  point  de  vue  cognitif,  comme  le 
commandement  et  le  controle  tactiques.  Or,  les  avantages  d’une  approche  centree  sur 
le  travail  et  qui  en  modelise  les  exigences  cognitives  pour  fonder  la  conception  d’un 
outil  sont  bien  etablis.  L’ analyse  du  travail  est  au  centre  d’une  telle  approche.  Les 
resultats  du  present  travail  permettent  de  mieux  comprendre  les  avantages  qu’apporte 
1’ Analyse  du  travail  cognitif  a  cette  analyse. 
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Travaux  a  venir 


Nous  continuous  a  travailler  sur  l’utilisation  de  1’ Analyse  du  travail  cognitif  du 
Central  operations  des  fregates  Halifax.  Ce  travail  permettra  de  modeliser  les 
echanges  de  renseignements  dans  le  travail  en  collaboration,  ainsi  que  les  flux  et 
l’integration  d’ informations  parmi  differentes  equipes,  lors  de  la  construction  et  du 
maintien  d’une  situation  tactique. 

Chalmers,  B.A.,  Burns,  C.M.,  and  Bryant,  D.J.  2001.  Une  analyse  du  domaine  de  travail  du 
commandement  et  du  controle  a  bord  des  navires.  TM  2001-212.  Centre  de  recherches  pour 
la  defense  Atlantique. 
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1.  Introduction 


Current  efforts  in  Canada’s  defence  research  community  to  develop  data  fusion 
technologies  for  the  shipboard  environment  hold  significant  potential  for  helping 
combat  operators  cope  with  the  data  explosion  problem  in  modern  warfare  and 
increasing  their  battlespace  awareness  and  decision  speed  and  accuracy.  For  example, 
automated  data  fusion  aids  promise  to  enhance  data  and  information  integration,  and 
thereby  reduce  the  cognitive  demands  on  operators  in  gaining  and  maintaining 
situation  awareness.  However,  realising  this  potential  will  be  extremely  challenging. 


The  literature  offers  numerous  examples  that  attest  to  the  difficulty  of  designing 
effective  computer-based  support  tools  for  operators  in  cognitively  demanding,  open 
work  environments.  In  this  type  of  environment,  operators  have  to  deal  with  a  large 
variety  of  work  situations  or  events,  from  familiar  ones  that  they  encounter  routinely, 
to  unfamiliar,  but  anticipated  ones,  to  ones  that  are  both  unfamiliar  and  unanticipated. 
In  particular,  unanticipated  disturbances  pose  variable  and  unpredictable  cognitive 
demands  on  operators  that  have  to  deal  with  them.  In  fact,  there  is  substantial 
evidence  that  an  impoverished  computer-based  “solution”  can  lead  to  substantial 
decrements  in  the  effectiveness  of  the  joint  human-machine  cognitive  system. 
Examples  include: 

•  the  burden  associated  with  supervising  automation  as  it  performs  an  offloaded 
task  can  outweigh  the  benefits  [1]; 

•  performance  decrements  can  result  from  automation-induced  complacency 
(over-trust)  [2]  and  biases  that  increase,  rather  than  decrease,  errors  as 
operators  come  to  rely  on  automated  cues  as  a  heuristic  replacement  for  their 
own  vigilant  information  seeking  and  cognitive  processing  [3];  and 

•  a  partially  automated  system  can  induce  more  errors  in  cases  where  its 
knowledge  is  incompetent  than  if  the  operator  is  left  in  the  loop  and  the  system 
simply  critiques  the  operator’ s  performance  based  on  recognising  operator 
violations  of  intrinsic  work  constraints  [4]  (e.g.,  brittleness  in  the  automated 
solution  in  the  face  of  variabilities  that  are  unanticipated  by  its  designers  where 
the  system  is  being  expected  to  function  outside  its  area  of  competence;  the 
operator  now  has  to  detect  and  diagnose  these  occurrences,  when  the  situation 
really  requires  the  operator  to  acquire  a  complex  understanding  of  local 
conditions  and  develop  solutions  to  resolve  problems  that  arise). 


Mistrust  of  a  computer-based  solution,  leading  to  its  disuse,  neglect,  or 
underutilization,  can  be  the  result  of  a  poor  design  (e.g.,  a  high  rate  of  false  alarms  in 
an  alerting  system)  [5] .  A  proposed  solution  may  also  act  as  a  barrier  to  the  operator’ s 
expertise  and  engagement  [6]  leading  to  skill  decay  or  dysfunctional  skills. 
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An  important  aspect  of  these  and  a  host  of  other  potential  problems  has  to  do  with  the 
“fit”  that  exists  between  the  work’s  cognitive  demands,  the  design  intervention  or 
solution,  and  the  operators  that  are  supposed  to  be  the  beneficiaries  of  its  support. 
Characteristic  of  a  Cognitive  Systems  Engineering  approach  to  cognitive  system 
design,  Woods  and  Hollnagel  [7]  suggest  that  the  key  to  the  effective  application  of 
computer  technology  for  supporting  humans  in  complex  problem-solving  worlds  is  to 
conceive,  model,  design,  and  evaluate  the  joint  or  interacting  cognitive  systems.  They 
emphasize  that  achieving  high  work  performance  rests  on  adopting  a  problem-driven, 
rather  than  a  technology-driven  approach  to  tool  development,  based  on  first  mapping 
the  cognitive  demands  of  the  work  environment.  The  overriding  challenge  is  to 
design  the  joint  human-machine  system  to  obtain  a  performance  that  is  greater  than 
could  be  achieved  separately  by  either  the  human  (individual  or  team)  or  machine 
acting  alone  in  the  face  of  these  work  demands. 


In  the  tactical  shipboard  setting,  these  considerations  require  that  we  first  understand 
the  cognitive  work  demands  posed  by  Command  and  Control  (C2)  as  a  basis  for  tool 
design  to  support  operators  [8] .  The  C2  work  environment  possesses  many  features 
that  usually  characterize  a  complex  sociotechnical  work  system,  such  as  uncertainty, 
dynamism,  team  work,  stress,  high  risk,  variable  and  unpredictable  cognitive 
demands,  and  large  and  growing  amounts  of  data  to  process.  Complexity  will 
undoubtedly  continue  to  grow  as  a  result  of  increasing  complexity  in  threat  scenarios 
(e.g.,  technological  advances  in  threats,  operations  in  littoral  environments)  and  as  the 
co-evolution  of  organization,  doctrine  and  technology  underlying  the  revolution  in 
military  affairs  [9]  imposes  increasing  demands  for  agile  and  adaptive  response  to 
rapid  change  at  all  C2  levels. 


For  example,  the  shift  from  platform-centric  to  network-centric  warfare  calls  for  the 
capability  to  self-synchronize  forces  in  real  time,  from  the  bottom  up,  while  at  the 
same  time  respecting  top  down  organising  principles  of  warfare  such  as  unity  of 
effort,  the  commander’s  intent,  and  rules  of  engagement  [9].  Operators  at  all  levels, 
from  the  platform  to  the  task  force,  will  therefore  need  to  deal  with  a  growing 
diversity  of  situations  or  events  spanning  the  familiar  ones  encountered  routinely,  to 
unfamiliar,  but  anticipated  ones,  to  both  unfamiliar  and  unanticipated  ones.  These 
latter  ones,  in  particular,  may  call  on  operators  to  actively  and  adaptively  frame  ill- 
structured  problems,  assess  the  situation,  and  derive  solutions.  Now,  more  than  ever, 
advanced  decision  support  systems  and  collaborative  or  integrative  work  aids  and 
displays  are  needed  to  help  operators  manage  the  increasing  amounts  of  information 
in  a  way  that  creates  flexible,  knowledge-based  problem  solvers  from  naval  command 
teams  and  harnesses  their  individual  and  combined  expertise  and  adaptive  capabilities 
to  the  full. 


In  [8],  we  proposed  a  framework  for  developing  and  testing  design  hypotheses  about 
advanced  computer-based  tools  to  support  operators  in  C2  work.  The  framework 
encompasses  a  set  of  activities  whose  combined  aim  is  to  develop  an  increasing 
understanding  of  the  environment’s  cognitive  demands  and  their  support 
requirements.  Work  analysis,  leading  to  explicitly  modeling  work  demands  tied  to 
design  requirements,  is  an  integral  component  of  the  activity  framework.  To  address 
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this  aspect  of  the  research,  we  identified  the  Cognitive  Work  Analysis  (CWA) 
framework  as  a  constraint-based  analysis  approach  that  is  particularly  suited  to 
complex,  dynamic  work  environments. 


The  CWA  framework  [10]  is  a  formative  approach  to  modeling  work  demands  in  the 
sense  that  its  aim  is  to  model,  in  an  holistic  manner,  the  intrinsic  constraints  that  shape 
the  work  to  be  done.  The  intrinsic  constraints  in  a  work  environment  are  those 
constraints  on  work  that  must  be  satisfied  if  it  is  to  be  performed  effectively, 
regardless  of  the  performing  agent  (human,  machine,  or  both)  of  that  work.  These 
models  are  then  used  to  identify  novel  possibilities  for  work  organization  and  support 
that  may  not  be  apparent  from  a  description  of  the  current  work  practice  alone  (a 
descriptive  approach).  This  approach  should  also  be  contrasted  with  one  founded  on 
shaping  the  work  as  the  designer  perceives  it  should  be  (a  normative  approach). 
Design  efforts  based  on  a  technology-driven  approach  have  generally  adopted  a 
normative  perspective,  with  a  focus  on  developing  an  essentially  autonomous  agent  to 
support  an  operator  who  plays  a  largely  supervisory  role  in  using  the  agent’s  services. 
The  potential  in  a  complex  work  environment  for  such  an  approach  by  itself  to 
produce  a  “solution”  with  unexpected  negative  consequences  for  joint  human-machine 
system  performance  should  not  be  surprising,  even  if  there  is  due  diligence  in  the 
course  of  its  development  to  make  the  interface  to  the  “solution”  as  user  friendly  and 
comprehensible  to  the  operator  as  possible. 


This  document  presents  results  from  an  ongoing  investigation  [8,  11]  of  the  feasibility 
and  value  of  applying  the  CWA  framework  to  the  design  of  computer-based  support 
tools  for  the  C2  work  environment  of  a  HALIFAX  Class  frigate.  We  examine  here 
only  one  aspect  that  is  concerned  specifically  with  the  first  of  CWA’s  layers,  a  Work 
Domain  Analysis.  A  Work  Domain  Analysis  (WDA)  was  conducted  in  a  year-long 
study  to  develop  a  hierarchy  to  structurally  represent  the  broadest  limits  of  the 
domain’s  constraints  that  create  tactical  action  opportunities  on  the  HALIFAX  Class 
frigate.  The  study  also  looked  at  some  specific  applications  of  the  models  that 
resulted  from  the  WDA. 


The  document  is  organized  as  follows.  Section  2  reviews  the  CWA  framework, 
focusing  on  the  key  features  of  its  first  layer,  which  consists  of  a  Work  Domain 
Analysis.  Section  3  outlines  some  of  the  principal  differences  with  other  applied 
domains  for  the  application  of  Work  Domain  Analysis  to  tactical  C2  for  the 
HALIFAX  Class  frigate  that  influenced  the  form  of  the  WDA  models  for  this  domain. 
The  method  that  was  followed  to  derive  these  models  is  also  discussed.  The  models 
derived  by  the  WDA  are  reviewed  in  Section  4.  Two  applications  of  the  WDA’s 
results  are  presented  in  Section  5.  Finally,  Section  6  provides  conclusions  and 
discusses  ongoing  work. 
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2.  Cognitive  Work  Analysis 


Cognitive  Work  Analysis  (CWA)  provides  a  layered,  analytical  approach  to 
representing  the  work  constraints  in  an  open,  complex,  dynamic  work  system.  CWA 
arose  from  work  first  done  in  the  nuclear  power  plant  domain  [10].  It  has  been 
successfully  applied  in  process  control  [12]  and  petrochemical  plant  control  [13]  to 
name  a  few  of  its  current  application  areas.  However,  it  has  so  far  received  only  very 
limited  attention  by  the  C2  R&D  community  [8]. 


Broadly  speaking,  CWA’s  focus  on  work  constraints  is  based  on  two  aspects  of  an 
underlying  design  philosophy  for  such  work  environments: 

■  Operator  support  tools  should  help  in  bounding  the  flow  of  work  so  that  it 
evolves  according  to  requirements  for  effective  work  performance,  without 
unnecessarily  overconstraining  its  performers. 

■  A  work  analysis  should  not  start  by  making  assumptions,  ab  initio,  about  the 
devices  or  tools  themselves  that  are  to  be  used  to  support  the  work  since  design 
concepts  for  such  tools  are  expected  to  be  developed  as  a  result  of  the  analysis. 
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The  constraints  that  CWA  aims  to  model  are  referred  to  as  behaviour-shaping  or 
intrinsic  work  constraints.  For  example,  the  CWA  approach  purposely  leaves  room 
for  operators  to  dynamically  adapt  at  their  discretion,  when  possible,  the  way  the  work 
is  performed  without  violating  its  intrinsic  constraints.  In  practice,  areas  of  operator 
adaptation  that  may  be  candidates  for  support  can  be  related  to  several  aspects  of  the 
work,  including  the  tasks  that  correspond  to  the  activities  that  are  carried  out  to 
achieve  specific  goals,  the  strategies  that  are  used  to  process  or  transform  existing  data 
and  knowledge  into  new  knowledge,  and  the  organizational  mechanisms  that  govern 
the  distribution  and  sharing  of  the  work.  These  various  aspects  are  addressed 
separately  in  the  various  layers  of  the  CWA  framework. 


This  modeling  focus  in  CWA  on  bounding  the  work  flow  so  that  it  evolves  according 
to  productive  “work  trajectories”  is  illustrated  in  Fig.  1 .  The  term  “work  trajectory”  is 
used  to  denote  a  specific  work  flow  in  the  envelope  shown  in  the  figure.  Strictly 
speaking,  the  work  trajectory  associated  with  a  specific  work  flow  depends  on  the 
elementary  components  used  to  parse  the  behavioural  flow  into  a  time-sequenced 
collection  of  constituent  elements  that  are  of  interest  for  the  analysis,  e.g.,  events, 
tasks,  knowledge  structures,  strategies,  decisions,  and  actions.  A  specific  work 
trajectory  may  therefore  be  represented  as  a  path  made  up  of  nodes  and  links  between 
successive  nodes,  labeled  by  various  elementary  components  employed  in  parsing  the 
behavioural  flow. 


Five  different  constraint  layers  are  distinguished  in  a  CWA,  each  one  corresponding  to 
a  different  type  of  behaviour-shaping  constraint.  A  complete  CWA  begins  with  a 
Work  Domain  Analysis  (WDA),  followed  by  analyses  of  Control  Tasks,  Strategies, 
Social-Organization  and  Cooperation,  and  Operator  Competencies  [10].  The  first 
three  layers  relate  to  what  Rasmussen  [14]  refers  to  as  the  “identification  of  activities” 
in  the  work  system,  and  the  last  two  to  the  “identification  of  agents  or  actors”  that 
perform  the  work.  This  separates  the  characteristics  of  the  work  environment  that 
must  be  satisfied  from  those  of  actors  responsible  for  their  satisfaction. 


An  important  feature  of  the  CWA  framework  is  that  there  are  specific  conceptual 
modeling  tools  associated  with  each  layer  that  can  be  used  to  represent  the  various 
cognitive  and  collaborative  demands  of  the  work  in  an  open,  dynamic  work  system.  It 
is  expected  that  these  tools  and  others  would  ultimately  be  part  of  a  concrete  and 
systematic  methodological  approach  to  designing  work  support  tools  for  such  work 
systems.  However,  exploiting  and  extending  CWA’s  modeling  tools  within  a 
rigorous,  codified  engineering  design  process  that  links  analysis  products  to  concrete 
design  solutions  aimed  at  supporting  operators  with  these  demands  [8]  remains  an 
active  area  of  research. 


The  work  models  derived  using  CWA’s  tools  permit  analysing  the  cognitive  demands 
of  the  work  over  the  range  of  situations  and  contexts  that  operators  can  face.  One 
example  of  the  variability  in  the  demands  that  may  need  to  be  captured  can  be  seen  by 
considering  Rasmussen’s  skills,  rules,  knowledge  (SRK)  taxonomy  [14]  that  is  part  of 
the  CWA  modeling  ensemble  [10].  Specifically,  it  characterizes  human  performance 
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according  to  three  qualitatively  different  levels  of  cognitive  processing  that  may  be 
involved  in  a  given  sense-act  loop,  from  sensing  or  acquiring  information  in  the  work 
environment  to  acting  on  objects  in  that  environment.  The  skill-based  level  captures 
highly  skilled  sensori-motor  performance  of  operators  based  on  using  an  effortless, 
internal  dynamic  world  model  in  their  sense-act  loop.  The  rule-based  level 
corresponds  to  routine  or  anticipated  situations  where  the  trained  operator  acts  by 
recognising  the  situation  as  typical  and  bases  his  or  her  response  on  recognitional  cue- 
action  mappings  and  rules1.  However,  in  less  familiar  or  unanticipated  situations,  this 
is  a  problematic  strategy.  These  situations  may  call  on  operators  to  actively  identify 
deep  features  of  the  situation,  construct  mental  models  of  these  features  and  their 
relations,  formulate,  diagnose  and  solve  problems,  and  generate  or  adapt  plans  and 
procedures  to  determine  course-of-action  responses.  This  last  level  of  cognitive 
processing  is  the  basis  of  what  Rasmussen  refers  to  as  knowledge-based  behaviour 
[14]. 

2.1  Work  Domain  Analysis 

We  now  examine  in  more  detail  some  of  the  principal  features  of  the  first  of  CWA’s 
layers,  referred  to  as  a  Work  Domain  Analysis,  which  is  the  focus  of  this  document. 
The  aim  of  a  WDA  is  to  develop  a  representation  of  the  dynamic  system  that  operators 
interact  with  during  the  course  of  their  work.  This  dynamic  system  is  also  referred  to 
as  their  work  domain.  More  specifically,  the  dynamic  system  and  its  components  are 
considered  from  a  teleological  perspective,  that  is  as  realizations  of  design  intentions 
for  the  puipose  of  satisfying  specific  needs  or  requirements.  The  representation  is 
derived  through  an  analysis  that  models  the  work  domain’s  constraints  by  abstracting 
the  system’ s  high-level  puiposes  or  objectives  and  functional  descriptions  from  its 
low-level  physical  details.  System  abstraction  therefore  plays  a  key  role  in  developing 
a  WDA  representation. 

Table  1.  Abstraction  levels  and  corresponding  system  knowledge  types  in  a  Work  Domain  Analysis 


ABSTRACTION  LEVEL 

KNOWLEDGE  TYPE 

Purposes 

Intentional 

Functions 

Intentional,  Causal 

Physical  Form 

Structural 

Abstracting  the  knowledge  about  a  system  on  various  levels  is  a  well-known  way  that 
operators  use  to  understand  and  operate  a  complex  system  without  being 
overwhelmed  by  its  complexity  [e.g.,  15].  However,  a  WDA’s  treatment  of  a 
system’s  complexity  has  some  distinguishing  characteristics.  First  developed  by 
Rasmussen  and  Lind  to  help  nuclear  power  plant  operators  cope  during  plant 
disturbances  [16],  it  integrates  a  variety  of  types  of  system  knowledge,  including 


i 


This  form  of  human  performance  also  underlies  Klein’s  recognition-primed  decision  model  [6]. 
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intentional,  causal  and  structural  knowledge,  as  indicated  in  Table  1,  as  a  way  of 
representing  the  knowledge  requirements  of  an  operator  engaged  in  goal-oriented, 
knowledge-based  work  on  the  system.  Intentional  knowledge  for  man-made  systems 
deals  with  design  intentions  about  how  the  system  (or  some  subsystem)  is  objectively 
to  satisfy  its  requirements.  In  other  words,  intentional  knowledge  permits  relating 
requirements  or  needs  to  system  objectives.  Causal  knowledge  is  concerned  with 
interactions  between  subsystems.  Structural  knowledge  is  knowledge  about  the 
system’s  physical  parts,  their  physical  characteristics  and  topological  connections. 


To  integrate  these  various  knowledge  types,  a  WDA  develops  a  multilevel  structure 
encapsulating  multiple  means-end  views  of  the  system.  In  a  particular  means-end 
view  spanning  two  successive  levels  of  the  structure,  an  end  on  one  level  and  its 
corresponding  means  on  the  next  (lower)  level  are  linked  by  a  means-end  relation2. 
For  example,  an  end  could  relate  to  some  objective  that  the  system  has  a  designed-in 
capability  to  accomplish  (i.e.,  the  end  in  this  case  corresponds  to  a  specific  design 
intention),  and  a  means  could  relate  to  the  capability  itself.  The  system’s  goals,  its 
purposes,  are  derived  from  the  system’s  intentional  knowledge.  They  are  represented 
at  the  highest  level  of  abstraction.  Means  are  derived  from  the  system’s  causal  and 
structural  knowledge.  These  are  represented  at  the  Functions  and  Physical  Form 
levels  of  abstraction,  respectively.  A  (system)  function  defines  a  role  conceived  by 
the  system’s  designers  that  it  can  play  in  achieving  its  purposes  [17].  For  this  reason, 
the  system’s  purposes  are  also  referred  to  as  its  Functional  Purposes.  As  indicated  in 
Table  1,  a  function  represents  both  intentional  and  causal  types  of  system  knowledge. 
Entities  represented  in  the  Physical  Form  level  are  the  system’ s  physical  means  of 
realising  its  functions.  In  general,  means-end  relations  will  be  many-to-many:  several 
functions  may  be  involved  in  achieving  one  puipose;  one  function  may  be  involved  in 
satisfying  multiple  purposes;  one  function  may  be  realized  by  means  of  several 
different  physical  entities;  and  one  physical  entity  may  be  used  in  effecting  several 
different  functions. 


This  type  of  system  representation,  combining  the  various  abstraction  levels  and  the 
means-end  relations  between  these  levels,  should  be  a  useful  multilevel  knowledge 
framework  for  operators  performing  knowledge -based  tasks  such  as: 


•  reasoning  about  mission  goals,  planning  and  decision  making; 

•  assessing  the  situation; 

•  determining  how  the  work  domain’s  functions,  resources  and  equipment  can  be 
used  to  achieve  goals;  and 

•  detecting,  framing,  formulating,  and  solving  problems  (e.g.,  as  a  consequence  of 
disturbances,  abnormal  events,  or  operational  deficiencies). 

2  These  links,  and  their  corresponding  knowledge  types,  are  not  shown  in  Table  1. 
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For  example,  the  means-end  relations  can  be  used  to  answer  ‘why’,  ‘what’,  and  ‘how’ 
questions  in  problem  diagnosis  and  planning:  a  link  from  an  object  (the  ‘what’)  on 
some  level  to  the  one  above  indicates  ‘why’  the  object  exists,  and  to  the  level  below 
‘how’  the  object  is  achieved  or  realized. 


Consistent  with  the  idea  illustrated  in  Fig.  1 ,  we  suggest  that  a  complete  WD  A 
representation  of  a  system  should  serve  to  delimit  the  full  range  of  trajectories  for  goal 
accomplishment  that  the  system  affords  operators  and  should  also  provide  a  means  of 
satisfying  their  knowledge  requirements  about  the  system  in  the  course  of  following 
these  work  trajectories3.  From  the  viewpoint  of  an  operator  interacting  with  the 
system  while  performing  a  knowledge-based  task,  one  can  interpret  this  property  in 
two  parts  as  follows.  A  WDA  representation  of  a  system  is  complete  if: 

1 .  any  work  trajectory  for  a  goal-oriented,  knowledge -based  task  can  be  mapped  onto 
a  path  in  the  system  representation  formed  by  model  entities  and  means-end  links 
between  these  entities  (Mapping  Property);  and 

2.  the  system  knowledge  required  or  used  in  following  the  work  trajectory  is 
represented  in  the  models  of  the  entities  that  are  encountered  during  the  traversal 
of  the  path  in  the  system  representation  that  corresponds  to  the  work  trajectory 
(Knowledge  Base  Property). 


Of  course,  in  a  specific  application,  this  property  of  a  WDA  representation,  as  a  map 
of  productive  work  trajectories  through  the  work  domain  and  as  a  system  knowledge 
base  for  these  various  trajectories,  can  only  be  expected  to  hold  for  the  knowledge 
types  that  the  representation  captures.  We  note  that  this  property  can  be  seen  to 
provide  the  motivation  for  a  number  of  concrete  applications  of  a  WDA.  For 
example,  a  WDA  has  been  used  to  determine  the  content  and  structure  of  an 
operator’s  display,  an  approach  that  has  been  shown  experimentally  to  lead  to 
improved  problem  diagnosis  and  more  effective  control  strategies  in  a  process  control 
environment  [18].  More  specifically,  the  Ecological  Interface  Design  framework  for 
interface  design  for  complex  sociotechnical  systems  [12,  18]  proposes  developing  this 


3  Lind  [17]  has  recently  argued  that  one  problem  for  a  WDA  is  that  there  is  as  yet  no  process  for 
building  a  WDA  model,  or  for  revising,  modifying  and  validating  that  model.  A  clearer  defining 
statement  of  precisely  what  it  is  a  WDA  sets  out  to  represent  is  a  necessary  step  toward  resolving  this 
problem.  Although  it  undoubtedly  raises  the  problem  of  “verifying”  the  conditions  involved,  the  notion 
of  a  complete  WDA  representation,  as  defined  by  the  conditions  expressed  in  (i)  and  (ii),  may  be 
helpful  here.  While  completeness  is  defined  there  with  respect  to  all  cognitive  trajectories  for  goal 
accomplishment,  it  may  also  be  helpful  to  narrow  the  conditions  to  specific  classes  of  trajectories, 
according  to  the  type  of  knowledge-based  tasks  on  the  work  domain  involved,  e.g.,  those  related  to 
situation  assessment  about  the  system  versus  those  involved  in  determining  action  responses  or  system 
interventions.  This  may  be  useful  in  targeting  the  knowledge  acquisition  work  underlying  model 
development  to  the  specific  WDA  model  to  be  built,  and  in  design  work  for  tying  the  purpose  of  that 
model  to  the  specific  set  of  cognitive  demands  that  are  to  be  supported.  We  mention,  however,  that 
examining  these  ideas  in  the  context  of  their  application  to  the  HALIFAX  Class  frigate  has  not  yet  been 
done.  The  present  discussion  of  the  properties  of  a  complete  WDA  representation  is  only  meant  as  a 
first  stab  at  developing  the  concepts  necessary  for  developing  a  better  understanding  of  a  WDA’s 
contribution  to  the  design  of  support  systems  in  this  environment. 
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type  of  system  representation  explicitly  in  the  operator  interface  as  an  external  system 
representation  to  support  the  operator’s  knowledge -based  problem  solving  interactions 
with  the  work  system.  In  our  current  applications  to  the  HALIFAX  Class  frigate,  we 
have  exploited  this  property  to  show  how  a  WDA  can  be  used  in  a  model-based 
approach  to  determine  information  requirements  for  tactical  operators  on  the 
HALIFAX  Class  frigate  and  to  evaluate  a  decision  support  system  for  this  platform. 
These  applications  are  discussed  in  Section  5. 


Separating  a  system’s  purposes  and  functions  from  its  physical  form  as  in  a  WDA 
system  representation  has  another  advantage  worth  mentioning.  It  divorces  the 
physical  means  available  for  instrumenting  the  system  (i.e.,  its  sensors  and  actuators), 
which  are  technology-paced  in  their  evolution,  from  its  puiposes  and  functions,  which 
will  evolve  entirely  independently  based  on  user  function  requirements.  This 
separation  should  be  a  useful  feature  of  a  system’s  representation  when  conducting  an 
analysis  of  the  impact  of  systemic  changes  at  one  or  more  of  its  levels4. 


Table  1  summarizes  only  the  rudiments  of  a  system’s  representation  that  may  be 
captured  in  a  WDA.  In  practice,  additional  levels  of  abstraction,  and  even  dimensions 
of  analysis,  can  be  involved.  For  example,  a  part-whole  dimension  can  be  used  to 
provide  various  levels  of  system  resolution  and  refinement  at  each  level  of  abstraction. 
Rasmussen’s  own  work  on  its  application  to  process  control  systems  suggests  that  five 
levels  of  abstraction  are  useful  for  representing  such  systems  [19].  In  this  case,  one 
interpretation  is  that  the  level  of  the  system’s  Functions  shown  in  Table  1  has  been 
developed  into  three  sublevels  of  functional  abstraction:  Abstract  Function, 
Generalized  Function,  and  Physical  Function.  The  full  set  of  five  levels  can  be 
summarized  as  follows  [10]: 

•  Functional  Purpose:  Purposes  for  which  the  system  was  designed; 

•  Abstract  Function:  Intended  causal  structure  of  the  system’s  functions  in  terms 
of  mass,  energy,  information,  or  value  function  flows; 

•  Generalized  Function:  Basic  functions  and  processes  that  the  system  has  been 
designed  to  achieve; 

•  Physical  Function:  Characteristics  of  the  system’s  physical  components  and  the 
connections  between  them;  and 

•  Physical  Form:  Appearance  and  spatial  location  of  the  system’s  physical 
components. 


4  A  full  representation  useful  for  such  an  analysis  of  the  HALIFAX  Class  frigate  might  be  derived  by 
developing  a  mission-operator-technology  functional  system  architecture  combining  mission 
requirements,  operator  functions,  system  functions,  and  technological  realizations  into  an  integrated, 
means-end  framework.  However,  such  possibilities  have  not  as  yet  been  explored. 
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Rasmussen  refers  to  this  system  representation  as  an  Abstraction  Hierarchy  [19].  In 
[10],  Vicente  uses  the  Abstraction  Hierarchy  as  the  conceptual  modeling  tool  for  the 
WDA  layer  of  a  CWA.  Lind  has  also  developed  this  modeling  approach  as  a 
framework  for  reasoning  in  supervisory  control  of  complex  dynamic  process  plants 
[17].  However,  although  it  is  derived  from  similar  origins  and  with  similar 
motivations,  he  refers  to  his  development  of  this  type  of  system  representation  as  a 
Multilevel  Flow  Model  (MFM).  This  reflects  MFM’s  principal  application  to  date  in 
continuous  processing  systems  that  can  be  described  by  combining  at  the  functional 
level  various  structures,  called  flow  structures,  of  mass  and  energy  flow  functions. 


Finally,  it  is  worth  noting  that  both  the  semantics  and  structure  of  this  type  of  system 
representation  are  a  continuing  source  of  research  and  debate  among  its  various 
proponents.  For  example,  Lind  [20]  argues  that  Rasmussen’s  Abstraction  Hierarchy 
suffers  from  both  methodological  and  conceptual  problems  (see  also  footnote  3).  In 
view  of  this,  it  is  not  surprising  that  the  details  underlying  a  WDA  and  its  framework 
for  system  representation  may  need  to  be  evolved,  refined,  or  even  developed  further 
as  the  range  of  its  application  domains  expands  and  new  requirements  are  uncovered 
in  these  domains.  We  have  certainly  found  the  need  for  this  in  our  own  application  of 
WDA  to  naval  C2. 


10 


DREATM  2001-212 


3.  Applying  Work  Domain  Analysis  to  the  HALIFAX 
Class  jrigate 

To  our  knowledge,  this  is  the  first  application  of  WDA  to  a  naval  work  domain.  In 
applying  it  to  tactical  C2  for  the  Canadian  Navy’s  HALIFAX  Class  frigate,  we 
realized  that  there  were  several  aspects  of  naval  C2  that  differ  from  previous 
applications  like  nuclear  power  plant  control  that  could  make  the  application 
challenging,  and  indeed,  could  require  further  development  of  the  WDA  framework  in 
order  to  handle  this  new  domain.  We  outline  some  of  the  key  differences  from  other 
domains  that  influenced  the  form  of  the  domain  representation  that  was  developed. 


Figure  2.  Role  of  physical  and  social-organizational  constraints  in  determining  actions 

Unlike  a  power  plant  that  is  easily  established  with  respect  to  its  purpose  and 

boundary,  these  elements  of  a  naval  system  can  be  very  difficult  to  fix. 

•  A  naval  frigate  can  be  tasked  with  a  large  variety  of  mission  types.  This  makes 
it  challenging  to  map  mission  and  operator  goals,  considered  as  requirements  to 
be  satisfied  using  the  frigate,  to  a  fixed  set  of  generic  frigate  purposes.  This 
should  be  contrasted  with  a  power  plant  which  ultimately  has  a  very  clear 
purpose  -  the  generation  of  electrical  energy. 

•  C2  entails  moving  and  controlling  entities  outside  of  the  ship  using  the  ship,  its 
on-board  or  off-board  organic  resources,  and  other  platforms  and  their 
associated  resources  also  under  its  control.  In  addition,  a  frigate  may  operate  in 
single  ship  or  task  group  operations,  involving  a  variety  of  C2  relationships 
between  the  frigate  and  its  interacting  parties  depending  on  the  mission  and  its 
warfare  role  in  that  mission.  It  does  not  make  sense,  therefore,  to  draw  the 
work  domain’s  boundary  at  the  ship’s  hull.  For  this  reason,  we  modeled  the 
domain  as  a  loosely  bounded  system,  including  the  frigate  and  other  entities 
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external  to  it,  where  these  entities  are  not  predetermined  in  the  model  and  could 
in  fact  have  a  variety  of  puiposes.  In  a  specific  operational  setting,  these 
entities  could  be  pursuing  goals  that  either  support,  oppose  or  are  neutral  to 
those  of  the  frigate’s  own  mission. 


Another  important  characteristic  of  the  shipboard  work  environment  is  that  any 
interaction  between  the  ship  and  external  entities  is  mediated  through  the  natural 
environment.  The  natural  environment  can  impose  limitations  on  movement  and 
constrain  the  use  of  sensors  or  weapons  and  impact  their  performance.  A  WDA 
model  of  this  domain  that  did  not  include  these  factors  would  be  ignoring  a  critical 
aspect  of  naval  operations.  To  model  the  environment  usefully,  we  therefore  modeled 
it  within  the  system  boundary  as  a  third  type  of  model  “entity”. 


A  final  key  difference  in  this  domain  is  that  as  well  as  managing  its  “physical” 
constraints,  operators  work  within  the  value  structure  of  their  organization.  For 
example,  constraints  arising  from  national  objectives  and  international  law  can  limit 
actions  beyond  those  that  are  achievable  based  only  on  the  capabilities  of  the  frigate’s 
physical  resources.  While  values  and  priorities  have  been  included  in  work  domain 
models  of  other  domains  before,  the  treatment  of  values  has  not  been  detailed.  We 
found  it  necessary  to  make  their  role  in  relation  to  the  domain’s  “physical”  constraints 
more  explicit  than  is  the  case  in  previous  applications.  We  have  done  this  by  making 
a  distinction  between  the  domain’s  physical  constraints,  the  domain’s  “hard 
constraints”,  which  cannot  be  broken,  and  its  social-organizational  constraints,  its 
“soft  constraints”,  which  can  be  broken  but  probably  will  not  or  should  not  be.  A 
good  example  of  a  soft  constraint  is  a  rule  of  engagement  (ROE)  which  is  designed  to 
remove  any  legal  or  semantic  ambiguity  that  could  lead  a  military  commander  to 
violate  policy  about  the  use  of  force  by  inadvertently  under-reacting  or  overreacting  to 
an  action  in  a  situation.  How  these  two  types  of  constraints  impact  the  space  of 
potential  action  is  shown  in  Fig.  2.  As  can  be  expected  with  a  constraint  hierarchy, 
adding  more  constraints  reduces  the  action  envelope,  reflecting  the  intersecting 
constraint  space  shown  in  the  figure. 


3.1  Method 


With  a  domain  this  complex,  it  was  not  possible  to  create  a  set  of  work  domain 
models  in  a  single  modeling  exercise.  We  chose  instead  to  go  through  several 
iterations,  stalling  first  with  a  skeletal  framework  of  the  work  domain  and  increasing 
in  model  complexity.  At  the  skeletal  level  (Section  4.1),  the  main  objective  was  to 
isolate  the  principal  parts  of  the  model  and  to  determine  a  boundary  for  the  system 
that  would  be  analysed  in  this  first  study.  The  second  iteration  provided  more  details 
of  the  physical  work  domain  (Sections  4.2  and  4.3).  The  third  iteration  incorporated 
social-organizational  (Section  4.4)  and  information  gathering  constraints  (Section  4.5) 
into  the  model. 
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Knowledge  acquisition  sessions  to  derive  the  data  for  the  models  used  a  variety  of 
operational  level  and  training  documents  dealing  with  the  principles  and  procedures  of 
maritime  warfare.  Various  quasi-structured  interviews  of  subject  matter  experts 
(SMEs)  were  conducted  among  the  Command  Team  in  the  HALIFAX  Class  frigate’s 
Operations  Room,  and  in  doctrine,  training,  naval  planning,  and  system  engineering. 
As  well,  a  number  of  complete  training  exercises  were  observed  in  a  land-based 
training  simulator  and  on  board  a  frigate  engaged  in  simulated  air  attacks  as  part  of 
harbour  exercises.  The  latter  was  augmented  by  a  field  trip  on  a  frigate  involved  in 
simulated  air,  surface  and  subsurface  warfare  exercises  in  a  task  group  setting  over  the 
course  of  a  three  day  sea  trip  between  Norfolk,  Virginia,  and  Halifax,  Nova  Scotia. 
This  was  used  to  capture  work  domain  constraints  that  would  not  be  available  in  a 
simulator  or  through  interviews.  The  field  trip  also  helped  confirm  modeling  work  in 
progress  at  the  time. 


Table  2.  Contribution  of  information  sources  by  model  entity 


Functional  Purpose 

High-level  design  documents  for  existing  system; 
naval  planning  personnel;  Command  Team 

Abstract  Function 

WDA  from  other  domains;  textbooks;  naval 
trainers 

Generalized  Function 

Training  publications;  textbooks  on  physical 
processes;  Command  Team;  ship  observations 

Physical  Function 

Low-level  system  design  documents;  documents 
on  the  frigate’s  combat  control  system;  data 
fusion  documents;  training  publications;  combat 
system  integrator;  ship  observations 

Physical  Form 

Physical  design  documents;  direct  observations 
on  ship 

Social-Organizational 

Constraints 

Articles  and  books  on  naval  doctrine;  naval 
history;  general  military  doctrine  and  history; 
naval  planning  and  policy  personnel 

Table  2  shows  how  the  various  knowledge  acquisition  activities  contributed  to 
developing  the  work  domain  models,  by  itemizing  the  information  sources  for  the  five 
abstraction  levels  that  we  used.  These  levels  correspond  to  Rasmussen’s  five 
abstraction  levels  for  process  control  systems  [19].  They  are  detailed  in  Section  4. 

We  also  include  a  separate  row  in  Table  2  for  the  WDA’s  social-organizational 
constraints. 


CWA  models  constructed  at  each  stage  were  evaluated  in  further  interviews  with 
SMEs  to  correct  misconceptions,  fill  in  gaps  in  the  models,  and  generally  test  their 
validity.  Validation  also  involved  walking  SMEs  through  a  training  scenario  to  make 
contact  with  the  elements  of  the  model  and  identify  model  deficiencies,  and,  in  a  final 
phase,  having  them  complete  detailed  questionnaires  testing  out  various  aspects  of  the 
final  versions  of  the  models,  including  model  completeness  and  frequency  of 
consideration  of  model  elements  across  a  variety  of  mission  types. 
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4.  Results  of  the  Work  Domain  Analysis 


We  review  here  some  of  the  modeling  results,  concentrating  on  their  general  features 
and  focusing  only  on  the  portions  specifically  related  to  the  frigate.  Additional  details 
about  the  models  appear  in  [21]. 

4.1  The  skeletal  model 


HALIFAX 

Natural  Environment 

External  Entity 

/  Purpose  \ 

/  \ 

/  Purpose  \ 

/  Principles  \ 

/  Principles  \ 

/  Principles  \ 

/  Processes  \ 

/  Processes  \ 

/  Processes  \ 

/  Physical  Capability  ' 

(  Physical  Capability/ 

Physical  Capability  \ 

/  Physical  Form  <- 

V — Physical  Forny  — 

Physical  Form  \ 

Figure  3.  Three  part  skeletal  model 


Consistent  with  our  remarks  in  Section  3,  three  principal  parts  of  the  model  were 
identified  at  the  skeletal  level,  consisting  of  the  HALIFAX  Class  frigate,  natural 
environment,  and  external  entity.  These  are  shown  in  Fig.  3.  The  part  designated  by 
the  external  entity  is  not  predetermined  in  the  model.  It  is  only  represented 
generically,  as  a  placeholder  for  any  class  of  purposeful  entity,  or  groups  of  such 
entities  (e.g.,  ships,  aircraft,  missiles,  submarines,  torpedoes),  that  would  need  to  be 
considered  as  part  of  the  work  domain  because  in  a  particular  operation  their  presence 
in  the  ship’s  external  environment  could  impact  in  some  way  the  execution  of  the 
frigate’s  mission  (e.g.,  the  frigate  can  impact,  or  be  impacted  by,  an  external  entity 
through  messages,  emissions,  or  the  use  of  weapons  or  other  measures  involving  the 
entity).  In  a  manner  compatible  with  their  purposes,  such  entities  could  be  pursuing 
goals  that  support,  oppose  or  are  neutral  to  those  of  the  Command  Team,  depending 
on  their  mission.  The  three  parts  of  the  model  interact  with  each  other  physically 
through  the  level  of  physical  form.  This  means  that  they  sense  each  other  beginning 
with  their  physical  form,  and  they  can  also  physically  make  contact  with  each  other  at 
this  level. 

Five  levels  of  abstraction  have  been  used  to  develop  the  model  as  shown  in  Fig.  3. 
Using  the  terminology  from  Rasmussen’s  levels  of  abstraction  for  process  control 
systems  [19]  (see  also  Section  2),  these  five  levels  are: 
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1.  Functional  Purpose:  the  Purpose  of  the  frigate  or  external  entity.  (Not  modeled  in 
the  case  of  the  natural  environment.) 

2.  Abstract  Function:  the  basic  causal  Principles  underlying  system  functioning  that 
govern  how  the  system’s  basic  purposes  are  achieved  and  how  the  system 
functions. 

3.  Generalized  Function:  the  Processes  that  can  be  involved  in  system  or  subsystem 
operation,  as  well  as  the  processes  that  govern  subsystem  interactions. 

4.  Physical  Function:  any  Physical  Capability  relevant  to  naval  operations. 

5.  Physical  Form:  the  Physical  Form,  condition,  state,  location,  and  interconnection 
of  the  components  that  realize  the  system’s  functioning. 

4.2  The  physical  work  domain 

Table  3  shows  in  more  detail  the  general  3-part  model  of  the  physical  work  domain. 


Table  3.  General  model  of  the  physical  work  domain 


Level 

HALIFAX 

Natural  Environment 

External 

Entity 

Functional 

Purpose 

Maximize  sea  control, 
achieve  movement, 
survive 

Achieve 
mission,  survive 

Abstract 

Function 

Flow  and  balance  of 
mass,  energy,  and 
resources 

Flow  and  balance  of  mass, 
energy,  creation  of  entropy 

Flow  and 
balance  of 
mass,  energy, 
and  resources 

Generalized 

Function 

Processes  of  moving, 
launching  resources, 
managing  watertightness, 
generating  signals 

Air,  water,  land  and 
electromagnetic  processes 

Processes  of 

moving, 

launching 

resources, 

managing 

physical 

integrity, 

generating 

signals 

Physical 

Function 

Capabilities  of 
equipment,  engines, 
weapons,  decoys 

Capabilities  of  air,  water, 
land  to  permit  movement, 
signal  propagation 

Capabilities  of 

equipment, 

engines, 

weapons, 

decoys 

Physical  Form 

Physical  location, 
condition,  shape,  size, 
markings  of  equipment 

Physical  location,  shape, 
size,  appearance  of 
environmental  features 

Physical 
location, 
condition, 
shape,  size, 
markings  of 
equipment 
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We  modeled  all  three  parts  at  five  levels  of  abstraction,  with  the  exception  of  the 
natural  environment.  The  level  of  Functional  Purpose  captures  the  design  intention  of 
the  work  domain.  This  did  not  apply  to  the  natural  environment  which  we  considered 
as  not  having  a  design  intention  in  the  same  sense  as  a  man-made  artifact.  The 
frigate’s  purposes  were  modeled  at  a  generic  level  to  permit  mapping  the  diversity  of 
its  mission  types  (escort,  patrol,  screening,  antisubmarine  warfare,  etc.)  onto  those 
purposes.  For  the  frigate,  we  defined  sea  control  as  purposes  outside  of  its  relocation 
for  controlling  a  designated  area.  Sea  control  captures  the  frigate’s  purpose  to  gain 
information  on  the  control  area  and,  if  called  for,  to  exert  influence  on  other  parties  in 
that  area. 


Functional  Purpose 


Maximise  Sea 
Control 


Abstract  Function 


Generalized  Function 


Processes  of 
Managing 
Watertightness 


Physical  Functiqp 


Hull  strength 
and 

watertightness 


Maintain  Own 
Survival 


Physical 
Processes  of 
Moving  Ship 

.. 


Launching  of 
Resources 


Personnel  Engine  Rudder 
Capability  Capability  Capability 


Fuel 


Move  from  A  to 
B 


Resource  Balance 

Mass  Balance  and 

Energy  Balance 

and  Flow 

Flow 

and  Flow 

- * 

h - 

Generating 

Signals 


Weapons 


Decoys 


Signal 

Generators! 


■ - fa 

T" 

-  .. 

-- 

| — 1 

Physical  J-'orin  = 

' 

it- 

Physical  shape, 
composition  of 
hull,  volume  of 
ship 

Location  of 
components 
on  ship  & 
ship  itself 

Signal 

Characteristics 

(signature) 

Physical 
Shape  Size 
Volume  of 
Components 

Colour 

and 

Visible 

Markings 

Material 

Condition 

Condition  of 
Personnel 

Figure  4.  A  model  of  the  physical  constraints  for  the  HALIFAX  Class  part  of  the  WDA 


At  the  Abstract  Function  level,  we  modeled  flows  of  mass  and  energy  for  all  three 
parts.  For  the  frigate  and  external  entity,  we  included  the  flow  and  balancing  of 
resources,  which  is  a  specific  type  of  mass  flow.  We  included  resources  as  a  separate 
model  entity  at  this  level  because  resources  cannot  easily  be  changed  from  one  type  to 
another.  With  the  natural  environment,  we  included  the  creation  of  entropy,  as  a 
natural  constraint  that  cannot  be  broken.  The  creation  of  entropy  describes  the 
tendency  of  the  environment  to  gradually  move  towards  a  state  of  disorder. 
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The  Generalized  Function  level  models  system  processes.  In  the  case  of  the  frigate 
and  the  external  entity,  the  primary  physical  processes  are  those  of  moving,  launching 
weapons  or  decoys,  and  generating  signals  deliberately  or  as  a  result  of  using  other 
equipment.  The  natural  environment  has  processes  of  precipitation,  movement  of  air, 
land  and  water,  and  signal  generation. 


The  Physical  Function  level  is  a  description  of  capabilities.  For  the  frigate  and 
external  entity,  we  described  the  capabilities  of  weapons,  engines,  decoys  and  other 
equipment.  In  the  case  of  the  natural  environment,  we  modeled  the  capability  of  air, 
land,  and  water  to  permit  locomotion  and  the  transmission  of  visible,  electromagnetic 
or  acoustic  signals. 


For  all  three  parts,  the  Physical  Form  level  describes  the  condition,  location,  and 
appearance  of  objects  in  the  work  domain.  For  the  frigate  and  external  entity,  we 
modeled  the  Physical  Form  of  equipment.  For  the  natural  environment,  we  modeled 
the  Physical  Form  of  land  and  water,  components  of  the  natural  environment. 


The  external  entity  model  is  quite  similar  to  the  frigate  model,  but  more  general.  We 
have  assumed  that  an  external  entity  has  a  “designed  for”  purpose,  with  a  mission  to 
accomplish,  and  some  level  of  resources  with  which  to  accomplish  that  mission. 
Depending  on  the  nature  of  a  specific  entity,  however,  elements  of  the  generic  model 
of  an  external  entity  will  be  more  or  less  relevant;  for  example,  not  all  purposeful 
entities  carry  weapons. 

4.3  Physical  HALIFAX  model 

Figure  4  shows  a  more  detailed  view  of  the  physical  constraints  of  the  HALIFAX  part 
of  the  WDA  model.  In  particular,  in  this  model,  we  have  shown  the  means-end 
connections  between  the  levels.  The  model  can  be  traced  through  as  a  chain  of 
functional  reasoning.  As  a  simple  example,  an  engine  has  a  certain  size,  form,  and 
acoustic  signature  (Physical  Form).  It  therefore  will  have  certain  capabilities  to 
produce  power  or  force  (Physical  Function)  and  acoustically  can  act  as  a  signal 
generator.  These  capabilities  contribute  to  the  frigate's  movement  processes  and 
signal  generating  processes  (Generalized  Function).  Movement  requires  using  energy 
through  fuel  to  move  the  mass  of  the  ship  (Abstract  Function).  The  ship  cannot  move 
farther  than  its  fuel  reserves  will  allow.  The  distance  that  the  ship  can  move 
determines  whether  it  can  move  to  its  next  required  location  (Functional  Purpose). 
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4.4  Social-organizational  constraints 
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Figure  5.  Integrating  physical  and  social-organizational  constraints  for  the  HALIFAX  Class  frigate 


As  discussed  in  Section  3,  we  modeled  value-based  properties  of  the  work  domain  as 
social-organizational  constraints.  We  chose  to  model  them  using  the  abstraction 
hierarchy  and  five  levels  of  description.  We  integrated  these  constraints  with  the 
physical  constraints  to  show  a  more  complete  model  of  the  work  domain.  This  is 
shown  in  Fig.  5,  where  only  the  links  related  to  the  added  social-organizational 
constraints  have  been  indicated.  Model  elements  in  the  social-organizational 
constraint  hierarchy  appear  in  the  grey  boxes  in  the  figure.  Additional  details  on  these 
constraints  appear  in  [2 1 ,  22] . 

4.5  Information  gathering  constraints 

In  addition  to  the  physical  and  social-organizational  constraints,  we  identified  and 
modeled  a  third  class  of  work  domain  constraint.  We  refer  to  this  third  class  as  the 
class  of  information  gathering  constraints.  In  Fig.  6,  these  constraints  (dark  shading) 
are  shown  integrated  with  the  previous  two  classes  of  social-organizational  (light 
shading)  and  physical  (unshaded)  constraints.  Unlike  the  frigate’s  physical  constraints 
which  relate  to  its  mass,  energy,  and  resource  flows,  information  gathering  constraints 
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stem  from  the  frigate’s  need  (part  of  its  functional  purpose)  to  gather  information  to 
allow  the  Command  Team  to  understand  the  work  domain  and  exercise  Command  and 
Control  in  accordance  with  the  frigate’s  mission,  role,  and  capabilities.  The  Abstract 
Function  level  of  these  constraints  deals  with  the  balance  and  flow  of  information,  and 
the  quality  and  completeness  of  those  flows. 


Figure  6.  Integrating  physical ,  social-organizational,  and  information  gathering  constraints  for  the 

HALIFAX  Class  frigate 


Note  that  whereas  active  sensors  are  included  in  the  physical  work  domain  of  the 
frigate  (because  of  their  ability  to  act  on  the  work  domain)  through  the  process 
element,  “Generating  Signals”,  and  the  capability  element,  “Signal  Generators”, 
passive  sensors  are  placed  instead  in  the  information  gathering  class  via  the  process 
element,  “Receiving  Signals”,  and  the  capability  element  “Signal  Receivers”.  In  fact, 
these  various  model  elements  can  also  be  viewed  as  representing  processes  and 
capabilities  associated  with  using  any  active  or  passive  information  source  internal  or 
external  to  the  frigate  (e.g.,  internal  platform  sensors  for  assessing  the  status  of  the 
frigate’s  systems,  meteorological  sensors  for  assessing  the  external  environment,  data 
links).  Finally,  note  that  since  an  active  sensor  in  the  physical  constraint  class  also 
plays  an  information  gathering  role,  these  constraint  classes  overlap.  This  is 
consistent  with  the  means-end  relation  shown  in  Fig.  6  between  the  “Information 
Balance  and  Flow”  and  the  “Generating  Signals”  model  elements. 


4.6  Work  domain  interactions 


We  have  already  mentioned  the  power  of  a  WDA  representation  to  support 
knowledge-based  reasoning.  The  power  behind  developing  a  3-part  model  in  this 
particular  domain  is  that  it  also  permits  a  description  of  work  domain  interactions  that 
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is  useful.  For  example,  the  model  can  describe  interaction  in  conflict,  and  also 
information  gathering  activities. 


Interaction  in  conflict:  In  this  case,  the  frigate  and  the  external  entity  interact  through 
the  natural  environment  (see  Fig.  3).  The  conflict  arises  due  to  the  incompatibility  of 
the  frigate’s  purpose  and  the  entity’s  purpose.  Both  apply  their  resources  to  each 
other,  at  the  level  of  physical  form,  using  them  through  a  natural  environment  that 
may  interfere  with  the  situation.  A  strike  by  a  weapon  will  change  the  components  of 
the  frigate  at  the  level  of  physical  form,  may  modify  its  capabilities,  and  impact 
whether  the  frigate  can  exert  sea  control. 


Information  gathering:  The  model  provides  a  useful  framework  for  defining 
information  needs  of  operators.  The  natural  environment  and  external  entity  side  of 
the  model  present  situation  assessment  needs  related  to  the  frigate’s  external 
environment.  For  example,  what  is  a  contact’s  purpose,  and  what  are  its  capabilities? 
How  are  the  frigate’s  capabilities  impacted  by  the  state  of  the  natural  environment? 
Detailing  these  sides  of  the  model  provides  a  systematic  way  of  identifying  the 
information  needs  of  the  Command  Team  for  establishing  thorough  awareness  of  the 
external  situation.  We  illustrate  this  use  of  a  WDA  in  Section  5.1 . 
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5.  Applications 


We  briefly  review  two  of  our  applications  to  date  of  the  results  of  this  WDA  for  the 
HALIFAX  Class  frigate.  As  previously  observed,  they  take  advantage  of  the 
observation  made  earlier  that  a  complete  WDA  representation  of  a  system  should  be 
both  a  map  of  all  productive,  knowledge -based  work  trajectories  through  the  work 
domain  and  a  system  knowledge  base  for  these  various  trajectories.  They  illustrate 
how  a  WDA’s  results  can  be  used  in  a  model-based  approach  to  two  problems: 
determining  information  requirements  for  tactical  operators  on  the  HALIFAX  Class 
frigate  (Section  5.1),  and  qualitatively  evaluating  display  information  about  the  work 
domain  provided  by  a  decision  support  system  (Section  5.2).  We  note  that  these 
WDA  applications  are  part  of  a  larger  project  [8,  1 1]  exploring  the  application  of  the 
CWA  framework  to  design  for  the  HALIFAX  Class  frigate  which  has  also  led  to  a 
preliminary  storyboard  of  new  display  concepts  for  tactical  decision  support  [23]. 

5.1  Derivation  of  information  requirements 

A  WDA  is  a  precursor  to  the  design  of  decision  support.  It  provides,  for  example,  a 
framework  that  can  be  used  to  generate  information  requirements  for  design,  both  in 
terms  of  data  that  need  to  be  collected  and  in  terms  of  information  that  needs  to  be 
derived  through  processing  this  data.  From  the  analysis  conducted  so  far,  many 
information  requirements  can  be  extracted  even  at  this  preliminary  stage  [24] .  Each 
level  of  the  work  domain  model  specifies  a  certain  kind  of  information  which  should 
be  provided  in  information  displays.  In  all,  from  the  complete  modeling  exercise,  we 
generated  1 32  unique  design  requirements  in  this  manner. 


Table  4.  Some  information  requirements  derived  from  the  HALIFAX  Class  model. 


Functional  Purpose 

Overall  ship  status,  location,  and  sea  control  status 

Abstract  Function 

Amounts  of  mass,  energy,  resources  stored  and 
usage  rates 

Generalized  Function 

Water  intake  and  outflow,  launch  dynamics  of 
weapons  and  decoys,  flight  trajectories,  range  and 
accuracy 

Physical  Function 

Weapon  capabilities  such  as  deployment  time, 
speed,  drag,  range,  blind  zone,  signal 
characteristics 

Physical  Form 

Frigate  location,  weapon  location,  condition, 
damage  level 

Tables  4,  5,  and  6  give  examples  of  information  requirements  which  can  be  derived 
from  each  of  the  three  parts  of  the  WDA  model  described  in  Section  4.  The  lowest 
levels  of  information  are  largely  available  right  now  from  frigate  sensor  systems, 
though  rarely  brought  together  in  a  single  display.  The  higher  levels,  however,  are  not 
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provided,  but  likely  could  be  obtained  from  models  or  by  using  various  algorithmic 
techniques  from  data  and  information  fusion  [25].  In  particular,  information  from  the 
external  entity  domain  is  critical  to  understanding  the  work  domain  properly. 


Table  5.  Some  information  requirements  derived  from  the  Natural  Environment  model 


Abstract  Function 

Mass  and  energy  levels 

Generalized  Function 

Signal  propagation  and  amplification  levels, 
forecasts  of  air  and  water  movement  processes 

Physical  Function 

Atmospheric  pressure,  wind  speed,  direction,  air 
temperature,  humidity,  sea  temperature,  salinity 

Physical  Form 

Sea/waterway  depth,  bottom  composition,  land 
height  and  elevation,  cloud  location  and  type 
location  of  an  ROE  boundary  (a  social- 
organizational  constraint) 

We  emphasize  that  the  power  of  the  WDA  analysis  here  is  that  it  provides  a  principled 
approach  to  deriving  these  requirements  based  on  deep  knowledge  about  the  work 
domain  that  can  be  systematically  represented  in  the  WDA  model. 


Table  6.  Some  information  requirements  derived  from  the  External  Entity  model 


Functional  Purpose 

Probable  contact  intent  and  mission 

Abstract  Function 

Probable  level  of  contact  resources  and  energy 
reserves 

Generalized  Function 

Contact  movement,  launch  dynamics,  processes  of 
generating  signals,  maintaining  integrity 

Physical  Function 

Capabilities  of  engines,  steering,  weapons,  decoys, 
fuel  level 

Physical  Form 

Physical  size  and  shape,  visible  markings,  material 
and  condition,  contact  location 

We  summarize  the  requirements  that  were  extracted  by  this  approach,  giving 
examples  from  each  level  of  the  work  domain  model. 


Functional  Purpose  Requirements:  This  level  requires  displays  of  goal  and  intent. 
For  the  frigate  this  could  mean  destination  location,  and  percentage  of  contacts 
identified  within  the  area  of  control  of  the  frigate.  It  also  means  knowing  the 
intentions  of  contacts,  their  missions,  and  planned  destination. 


Abstract  Function  Requirements:  Information  displays  should  show  balances  and 
flows  of  elements  that  must  be  conserved.  Displays  of  energy  levels  and  flow,  mass 
levels,  and  resource  levels  and  expenditures  would  be  information  at  this  level.  The 
Command  Team  of  the  frigate  should  understand  their  own  resource  use,  as  well  as 
resource  use  by  contacts. 
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Generalized  Function  Requirements:  This  level  requires  the  display  of  process 
information.  Information  on  the  watertightness  system,  movement  processes  and 
launch  processes  should  be  displayed.  Similarly,  the  frigate’s  Command  Team  should 
receive  this  information  on  the  contacts  in  their  area  of  interest.  To  anticipate  weather 
problems  and  deploy  resources  appropriately,  temperature  and  pressure  values  for  air 
and  water  would  be  useful. 


Physical  Function  Requirements:  This  level  specifies  capability  information  that 
should  be  displayed.  The  capability  of  equipment  on  the  frigate  and  on  any  contacts 
should  be  provided.  As  well,  the  capability  of  water  to  affect  sonar  readings,  or  air  to 
reduce  visibility  are  examples  of  environmental  capabilities  specified  by  the  model. 


Physical  Form  Requirements:  The  information  requirements  derived  at  this  level  are 
for  physical  location  and  appearance  information.  The  Command  Team  must  know 
its  location  as  well  as  the  location  of  all  contacts.  Similarly  the  boundaries  of  land  and 
water  must  be  known,  which  includes  shorelines  and  waterway  depth.  Physical 
markings  are  one  way  of  identifying  contacts  and  are  another  kind  of  information  that 
should  be  available. 

5.2  Evaluation  of  the  TADMUS  decision  support  system 

A  WDA  provides  representations  of  a  dynamic  work  system  to  enable  operators  to 
reason  efficiently  about  the  system  and  make  decisions  about  possible  interventions, 
at  the  knowledge-based  level.  This  suggests  that  the  presence  or  absence  of  such 
representations  in  operator  displays  may  provide  a  model-based  approach  to 
qualitatively  evaluate  the  effectiveness  of  a  proposed  or  existing  decision  support 
system.  This  is  supported  by  some  evidence  in  process  control  applications  [18]  of 
the  effectiveness  of  basing  display  design  on  the  products  of  a  WDA.  To  demonstrate 
this  use  of  a  WDA  for  evaluation  purposes,  we  used  preliminary  WDA  results  for  the 
HALIFAX  Class  frigate  to  conduct  a  work  domain  review  of  the  TADMUS  (Tactical 
Decision  Making  Under  Stress)  Decision  Support  System  (DSS)  [26], 


The  TADMUS  program  was  initiated  in  response  to  the  accidental  shoot-down  of  a 
commercial  airliner  by  the  USS  Vincennes  in  1988.  One  of  the  program’s  results  was 
a  DSS  to  support  the  decision  making  of  command-level  decision  makers  aboard  an 
AEGIS  class  cruiser.  Its  design  applied  two  intuitive  models  of  decision  making, 
feature  matching  and  story  generation,  that  experienced  decision  makers  have  been 
found  to  employ  in  time -pressured,  critical  situations  to  make  rapid  situation 
assessments  and  course  of  action  selections.  The  DSS  organizes  incoming  data  and 
displays  it  in  a  form  that  highlights  important  features  and  relations  so  as  to  reduce 
cognitive  and  attentional  demands  of  operators.  The  DSS  itself  is  organized  into 
various  display  modules  that  carry  out  these  functions.  Notably,  the  design  approach 
was  not  based  on  an  approach  of  ensuring  that  a  complete  picture  of  the  work  domain 
would  be  presented  to  the  operator. 
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We  compared  the  DSS’s  display  to  the  work  domain  model  we  derived  for  the 
HALIFAX  Class  frigate  to  determine  the  extent  to  which  the  information  content  and 
organization  of  the  TADMUS  DSS  corresponded  to  that  of  the  current  model.  In  a 
limited  one-day  review,  it  was  determined  that  the  DSS’s  display  corresponds  to  only 
a  small  portion  of  the  work  domain  model.  The  DSS  presents  information  about  the 
own  ship  and  contacts  primarily  at  the  levels  of  generalized  functions  and  physical 
functions,  focusing  mostly  on  weapons,  sensors,  and  decoys.  The  DSS  presents  some 
information  that  can  be  used  to  assess  level  of  risk.  The  natural  environment  is  the 
least  represented  aspect  of  the  work  domain.  In  this  manner,  several  elements  of  the 
work  domain  were  identified  that  might  be  useful  to  add  to  a  TADMUS-like  display 
for  a  HALIFAX  Class  frigate  [27].  We  emphasize,  however,  that  determining 
whether  these  missing  elements  are  indeed  display  requirements  of  the  operators  who 
are  to  benefit  from  this  DSS  would  need  to  be  based  on  a  closer  analysis  of  their 
workspace  and  decision  requirements. 
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6.  Conclusions 


CWA  has  been  specifically  developed  to  meet  the  challenges  of  complex 
sociotechnical  systems,  but  it  has  so  far  received  limited  attention  by  the  C2  R&D 
community.  While  there  are  many  reasons  to  believe  that  there  is  a  good  fit  between 
the  demands  imposed  by  C2  and  the  characteristics  of  CWA,  it  is  important  to  provide 
a  basis  for  evaluating  this  fit.  This  will  develop  an  improved  understanding  of  the 
value  of  CWA  to  ongoing  efforts  in  Canada’s  defence  research  community  to  explore 
concepts  for  the  design  of  support  systems  suitable  for  the  tactical  work  environment 
of  the  HALIFAX  Class  frigate  and  for  the  integration  of  such  systems  into  the 
architecture  of  its  combat  control  system  [28], 


To  this  end,  we  demonstrated  that  a  work  domain  model  can  be  developed  for  a  naval 
frigate,  though  this  necessitated  some  novelty  in  the  way  we  used  WDA  to  be  able  to 
handle  the  scale  and  complexity  of  the  domain  involved.  The  model  presented  in  this 
document  is  unique  in  the  Work  Domain  Analysis  literature  with  its  three  paid 
modeling  of  the  frigate,  the  environment,  and  the  external  entities.  This  represents  an 
extension  of  the  original  framework  proposed  by  Rasmussen  and  is  an  innovative 
approach  to  modeling  the  interactive  aspects  of  this  domain.  Based  on  this  model, 
information  requirements  can  be  derived,  suggesting  a  model -based  approach  to 
developing  naval  C2  support  systems  for  enhancing  human  decision-making 
performance.  A  further  step  in  this  direction  would  be  to  explore  more  specifically 
the  advantages  of  developing  the  WDA  system  representation  explicitly  in  the 
interface  to  support  the  operators’  knowledge -based  interactions  with  the  work 
domain.  This  could  be  along  the  lines  proposed  in  the  Ecological  Interface  Design 
framework  [12,  18].  The  specific  aim  would  be  to  examine  how  the  WDA  system 
representation  might  be  used  to  support  operators  in  building  accurate  mental  models 
[29]  of  their  work  domain,  and  in  reasoning  with  these  models,  as  part  of  their 
situation  assessment,  problem  solving,  and  decision-making  activities.  A  partial  first 
step  in  this  direction  has  been  taken  in  the  work  described  in  [23]. 


However,  our  experience  has  also  shown  that  detailing  a  complete  work  domain 
model  would  be  an  extensive  project  requiring  a  significant  investment  in  resources, 
time  and  funding.  Balanced  against  the  need  already  mentioned  in  Section  2. 1  for 
further  developments  in  the  methodological  and  conceptual  underpinnings  of  a  WDA 
[20],  this  suggests  that  a  focused  application  of  CWA  in  this  environment  is  called  for, 
to  give  optimal  value  for  analytical  investment.  Two  such  efforts  currently  being 
pursued  by  Defence  Research  Establishment  Atlantic  (DREA)  are  described  in 
Section  6.1. 
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6.1  Ongoing  work 


DREA  is  currently  investigating  using  CWA  in  the  HALIFAX  Class  Operations 
Room  to  model  information  exchange  in  collaborative  work,  and  information  flow 
and  integration  among  the  different  teams  in  building  and  maintaining  a  tactical 
picture,  concentrating  on  situations  that  call  for  operator  adaptation  of  an  existing 
plan,  or  established  procedures,  in  the  face  of  unforeseen  circumstances  occurring  in 
real  time. 


Modeling  information  exchange:  The  objective  is  to  study  the  feasibility  and  benefits 
of  using  the  Work  Domain  Analysis  of  the  HALIFAX  Class  frigate  to  model 
information  exchange  requirements  in  collaborative  work  (i.e.,  work  that  requires 
dynamic,  interdependent  and  adaptive  interaction  toward  a  common  goal)  among  key 
members  of  the  Operations  Room  team  over  the  course  of  a  mission  segment  or  threat 
response  to  serve  as  a  basis  for  the  design  of  computer-based  tools  to  support  these 
work  demands. 


The  basic  idea  here  is  that  if  the  WDA  model  is  complete  with  respect  to  the  Mapping 
and  Knowledge  Base  Properties  described  in  Section  2.1,  we  should  be  able  to 
identify,  by  mapping  operator  work  trajectories  onto  the  WDA  model,  how  these 
trajectories  interact  with  respect  to  their  information  exchange  requirements.  For 
example,  an  analytical  approach  could  look  at  how  the  knowledge  requirements  at 
intersecting  points  of  overlapping  work  trajectories  (with  respect  to  the  current 
operator  organization)  lead  to  information  exchange  requirements  among  the  different 
operator  specializations  by  analysing  the  model  components  in  the  WDA  model  that 
correspond  to  these  intersecting  points.  Information  exchange  arises,  for  example, 
when  the  outcome  of  information  processing  by  one  operator  position  is  needed  by  the 
overlapping  work  trajectory  of  another  position.  Knowledge  elicitation  techniques  in 
the  Human  Factors  and  Cognitive  Psychology  literature  (e.g.,  [30])  could  also  be  used 
to  support  or  confirm  an  analytical  approach.  Analysing  how  such  requirements  are 
currently  satisfied  could  then  be  used  to  identify  in  a  model-based  manner  new  ways 
of  supporting  these  operator  demands. 


Modeling  information  flow  and  integration:  The  objective  is  to  develop  Cognitive 
Systems  Engineering  models  of  information  flow  and  integration  in  Maritime  Tactical 
Picture  (MTP)  Compilation  in  the  Operations  Room  of  a  HALIFAX  Class  frigate  as  a 
basis  for  the  design  of  computer-based  tools  to  support  operators  in  building  and 
maintaining  the  tactical  picture.  The  MTP  is  the  situation  picture  needed  to  support 
all  aspects  of  tactical  operations  over  an  area  of  interest  of  a  maritime  commander.  It 
provides  a  comprehensive  picture  that  the  commander  can  use  as  a  tool  to  develop  and 
maintain  awareness  of  the  battle  space  and  make  tactical  decisions  to  achieve  the 
mission.  It  is  anticipated  that  operator  support  will  involve  incoiporating  advanced 
processing  capabilities,  based  on  data  and  information  fusion,  into  their  tactical 
picture  compilation  work  [28]. 
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These  cognitive  engineering  models  will  be  derived  primarily,  though  not  necessarily 
exclusively,  from  existing  conceptual  modeling  tools  in  the  CWA  framework  [10],  or 
based  on  refinements,  extensions,  or  adaptations  of  such  tools  as  our  understanding  of 
this  work  environment’s  modeling  needs  is  developed.  As  an  example  of  the  scope  of 
the  modeling  work  that  may  be  considered,  one  modeling  approach  proposed  by 
DREA  that  also  has  the  advantage  of  building  on  the  results  of  the  existing  Work 
Domain  Analysis  for  the  HALIFAX  Class  frigate  is  to  first  model  the  dynamic  work 
flows  in  picture  compilation  tasks  of  individual  operators  using  decision  ladder 
models  [10].  This  would  represent  a  Control  Task  Analysis  [10]  of  individual 
operators’  picture  compilation  work.  To  model  vertical  and  horizontal  data  and 
information  integration  flows  among  the  operators,  the  basic  decision  ladder  tool 
could  be  extended  to  allow  linking  individual  operator  ladders,  or  their  associated 
processing  activities,  to  represent  the  full  range  of  potential  flows.  In  a  further 
extension  of  the  usual  CWA  tool  set  [10],  goal  dependencies  and  other  goal-related 
constraints  among  operator  tasks  could  be  represented  separately  by  various  graph 
structures  (e.g.,  an  AND/OR  tree  structure).  Coordination  constraints  among 
individual  operator  processes  could  also  be  separately  represented  graphically,  with 
individual  operator  processes  represented  as  nodes  and  links  between  nodes 
representing  precedence  or  logical  constraints  on  those  processes.  Graphically-based 
techniques  and  other  techniques  from  the  Knowledge  Representation  and  Artificial 
Intelligence  literatures  could  also  be  examined  for  their  capability  to  represent  other 
types  of  task  constraints,  task  processing,  coordination  strategies,  or  knowledge 
requirements  (e.g.,  use  of  Gantt-like  bar  charts  to  represent  temporal  task  constraints, 
information  flow  maps  to  represent  strategies  as  part  of  a  Strategies  Analysis  [10]). 
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